i(iir@ m 

SYSTEMS NEUROSCIENCE 



OPINION ARTICLE 

published; 15 May 2014 
doi: 10.3389/fnsYS. 2014.00086 




Minds, motherboards, and nnoney: futurism and realism in 
the neuroethics of BCI technologies 

Mark A. Attiah and Martha J. Farah^^ 

' Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA 
^ Center for Neuroscience & Society, University of Pennsylvania, Philadelphia, PA, USA 
^ Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA 
'Correspondence: mattiah@mail.med.upenn.edu 

Edited by: 

Mikhail Lebedev, Duke University, USA 
Reviewed by: 

Manuel Casanova, University of Louisville, USA 
Mikhail Lebedev, Duke University, USA 

Keywords: neuroethics, brain computer interface (BCI), transhumanism, implants, experimental, enhancement 



INTRODUCTION 

Brain computer interfaces (BCIs) are sys- 
tems that enable the brain to send and 
receive information to and from a com- 
puter, bypassing the body's own effer- 
ent and afferent pathways. BCIs have 
been used in experimental animal mod- 
els to augment perception, motor control 
and even memory (Velliste et al., 2008; 
Berger et al, 2011; Torab et al, 2011). 
Human BCIs include cochlear implants 
and a host of experimental devices includ- 
ing retinal implants (Niparko et al, 2010; 
Klauke et al., 2011). BCI technology 
holds the potential to benefit human- 
ity greatly, but also the potential to do 
harm, and its ethical implications have 
therefore been addressed by a number of 
commentators. 

THE PROBLEM WITH SCIENCE FICTION 

Commonly addressed ethical challenges 
with BCIs concern a future when the tech- 
nology is used to give people superhu- 
man abilities, or to control their thoughts 
and desires. The idea of human beings 
with computer-augmented brains engen- 
ders a wide range of reactions from layper- 
sons, mostly negative (Lipsman et al, 
2009; Lebedev, 2014). There is revulsion 
toward these so-called cyborgs occupy- 
ing the "uncanny valley" between fel- 
low human and robot (Mori, 1970). 
Some fear being overtaken by cyborgs 
with superior perceptual, cognitive and 
motoric powers while others are afraid that 
BCIs imposed upon us would result in 
mind control. Still others foresee tremen- 
dous benefit for humanity, with BCI 



enhancements elevating individuals and 
society. 

Positive or negative, these images of 
computer-augmented brains are as spec- 
ulative as they are vivid. Therein lie two 
significant challenges for ethical analysis 
of BCIs. First, we have strong emotional 
reactions to the prospects of humans 
with cyborg brains. Second, our limited 
real-world experience with BCIs deprives 
our ethical analyses of a foundation 
of pragmatic empirical knowledge. As 
a result, our perspectives on the eth- 
ical and societal impact of BCIs are 
based primarily on gut reactions, either 
"the wisdom of repugnance" (as exem- 
plified by Francis Fukuyama's nomina- 
tion of transhumanism as "The World's 
Most Dangerous Idea, 2004") or the 
blind faith that technology can fix and 
improve everything (as exemplified by 
the mission statement of Humanity-|-, 
which promotes "the ethical use of tech- 
nology to expand human capacities. . . [to 
make them] better than well" (http:// 
humanityplus . org/ ) . 

In this essay, we describe an approach to 
the ethical analysis of BCIs that resists the 
emotional pull of futuristic scenarios with- 
out denying the importance of the ques- 
tions they raise. In so doing, we address the 
more prosaic ethical issues that confront 
us now, which are too often overshad- 
owed by the more sensational prospects of 
cyborgs, mind control and transhuman- 
ism. Finally, we indicate pathways through 
which seemingly fantastical futuristic sce- 
narios can be more knowledgeably antici- 
pated and addressed. 



THREE ERAS OF BCIS AND THEIR 
ETHICAL CHALLENGES 

As an organizing framework, we wiU dis- 
tinguish among three different eras of BCI 
development, near-term, medium-term, 
and long-term, and distinguish among 
the different ethical issues associated with 
each. 

LONG-TERM CHALLENGES 

The futuristic ethical concerns already 
mentioned arise in the long-term future. 
We define this era as when BCIs are rou- 
tinely used to augment human brains, 
giving users perceptual, cognitive and 
motoric abilities that may greatly exceed 
those of the unenhanced, and transform- 
ing emotional life as well. At this point, 
cyborgs will differ radically from unen- 
hanced humans. One concern is that they 
will view us as a different, and inferior, life 
form, much as we now regard chimpanzees 
(Warwick, 2003). Loss of individuality is 
another long-term future scenario. If BCIs 
are used for direct brain-to-brain contact, 
this would enable new modes of com- 
munication but also lead to the possible 
replacement of individual mental lives by 
a network in which individual brains are 
mere nodes (Warwick, 2003). 

Thoughts, feelings and memories that 
can be stored and shared as bits of data 
will not degrade as readily as human brain 
tissue. While other prosthetics such as arti- 
ficial hips or heart valves can replace failing 
bodily structures, BCIs offer the first pos- 
sibility of increased longevity of a person's 
consciousness. Immortality may even be 
possible (McGee and Maguire, 2007). 



Frontiers in Systems Neuroscience www.frontiersin.org May 2014 | Volume 8 | Article 86 | 1 



Attiah and Farah 



Minds, motherboards, and money 



These BCI scenarios lead to interest- 
ing questions about what it means to be 
human. Would we be human if we could 
see infrared light, memorize a phone book, 
or cause others to move by willing them 
to with our own mind? Would we be 
human if we ceded the role of smartest 
beings on earth to others, or would those 
enhanced beings be humanity's new form? 
Would we be human if our minds never 
operated independently from others'? If 
they operated for eternity? These ques- 
tions raise the more general question of 
what it means to be human, and also the 
question of whether being human by any 
particular definition has intrinsic value. 
Although these questions are age-old, they 
arise with a new urgency in connection 
with advanced BCIs (McGee and Maguire, 
2007). 

BCIs could eventually bring about tec- 
tonic societal shifts. The effects of cochlear 
implants on deaf culture (Tucker, 1998) 
may presage the impact of BCIs on all 
aspects of human culture that are adapted 
to current human capabilities rather than 
the augmented, networked capabilities of 
future cyborgs. Global political trends 
such as the Arab Spring, attributed in 
part to social networking, could be distant 
harbingers of the effect of wide bandwidth 
BCIs that enable the sharing of thoughts 
and feelings among groups of individuals. 

MEDIUM-TERM CHALLENGES 

The ethical challenges of the medium term 
wUl be largely free of the existential and 
metaphysical dimensions just discussed, 
such as ceding dominion of the earth to 
others, merging our identities into a global 
network, or questioning the meaning and 
value of being human. Yet the emer- 
gence of these medium-term challenges 
will depend on BCI technology advanc- 
ing significantly beyond its current state 
and therefore do still have a science fic- 
tion flavor. We take the defining feature of 
the medium-term to be the availability of 
BCI therapies for a wide range of human 
afflictions. 

One set of ethical issues at this point 
will concern barriers to delivery of BCI 
therapies. One barrier is likely to be eco- 
nomic. The cost of BCIs in the coming 
decades is hard to predict, as is future 
societal support for universal access, but 
we can anticipate some degree of inequity 



in access to BCIs. Patient acceptance 
of implants, in particular the bioethi- 
cists' "yuck factor" (Niemela, 2011) may 
also prevent or slow delivery of BCI 
therapies. 

Another issue with a degree of bioeth- 
ical precedent concerns control of the 
BCI (Jebari and Hansson, 2013). Therapies 
vary in how much control patients have. 
How much adjustment or programming of 
a BCI by the patient will be feasible, and 
with what risks and benefits? An aspect of 
control with much less precedent concerns 
the possibility of BCI hacking, that is, the 
possibility that a third party, unbeknownst 
to patient and healthcare provider, would 
deliver inputs to a patient's brain or 
read brain states (Denning et al., 2009). 
Although safeguards against such inter- 
ventions could of course be designed into 
any system, experience with current infor- 
mation technology shows that no system 
can ever be made entirely invulnerable to 
such attacks. This raises the dire prospect 
of hacking into systems controlling human 
thought, feeling and behavior. 

Finally, as BCIs are adopted more 
widely for therapeutic use, enhancement 
uses will likely follow. The ethics of 
enhancement is a well-explored area in 
bioethics and neuroethics more specifi- 
cally (Parens, 2000; Farah et al, 2014). 
However, compared to the effects of drugs, 
which only modulate function within 
existing brain networks, the addition of 
new sensory, action and computational 
devices has the potential to more radically 
enhance human capabilities. 

The transition from therapy to 
enhancement is evident in many areas of 
medicine: from neuropsychiatry, where 
attention-boosting drugs are used by 
college students to enhance their focus 
and improve their grades (Sussman 
et al., 2006), to plastic surgery, where 
techniques developed to reconstruct 
injured faces are now commonly used 
to enhance the attractiveness of the unin- 
jured. Therapeutic implantation of BCIs 
for only mildly impaired individuals could 
provide a bridge between therapy and 
enhancement uses of BCI. Another path- 
way along which BCIs could transition 
from therapy to enhancement is by the 
addition of enhancing BCIs for someone 
who is already undergoing therapeu- 
tic implantation for a serious disorder. 



for example increasing the range of 
wavelengths perceived by someone with 
impaired vision. 

NEAR-TERM CHALLENGES 

Compared with the challenges awaiting us 
in the medium and long-term, which are 
currently speculative, we are now faced 
with a set of ethical challenges that are 
clear and present. How we respond to 
these challenges will determine the path 
we take to the medium- and long-term 
challenges of BCIs. One set of ethical 
challenges concerns clinical trials — how 
trials are conducted and which indica- 
tions are pursued. Economic considera- 
tions of course shape these decisions, and 
the ethical issue is how these considera- 
tions will be balanced by other consider- 
ations. Will BCIs be developed only for 
the most profitable applications, leaving 
numerous "orphan" medical conditions 
unaddressed? How will an emphasis on 
profitability shape the future of BCI tech- 
nology, by advancing technology for cer- 
tain applications over others? 

A related set of immediate challenges 
concerns ownership of products during 
research and development. The finances 
of pharmaceutical research and develop- 
ment has been identified as an impedi- 
ment to discovery and innovation (Cohen, 
2005), as well as a disincentive for scientific 
objectivity and transparency (Goldacre, 
2013). Given the extensive collaboration 
of academic and other publicly funded 
researchers with privately held device 
manufacturers, how should we design 
intellectual property agreements, clinical 
trials and regulation to maximize innova- 
tion and patient benefit? 

APPROACHING THE FUTURE STEP BY 
STEP 

We cannot help but approach the future 
step by step. In contrast, ethical analy- 
ses sometimes jump ahead. This is moti- 
vated by the commendable desire to 
anticipate, and therefore more effectively 
address, the ethical issues of the future. But 
this long-term ethical forecasting can be 
counterproductive. One reason is that it 
takes our attention away from the vitally 
important, if more mundane, ethical 
issues of today. Pondering what it means 
to be human may be more interesting 
than projecting research and development 
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Table 1 | Three eras of BCIs and their corresponding ethical challenges. 



Time period 


Characteristics 


Ethical challenges 


Long-term 


Extensive enlnancement of 


Transhuman cyborgs' treatment of humans as 




human brains with BCIs 


inferior and inconsequential 






Vulnerability of those with BCIs to thought control 






and mind-reading 






Loss of individuality to a merged group mind 






Immortality of thoughts, memories and whole 






minds 


Medium-term 


Routine use of BCIs as therapy 


Cost of BCIs as an obstacle for needy patients 






Discomfort or disgust with implants as an obstacle 






for patients 






Question of who controls operation of patients' 






BCIs 






Security of BCIs against hacking 






Acceptance of BCIs for enhancement of normal 






function 


Near-term 


Use of BCIs in a translational 


Conduct of clinical trials 




research setting 


Developing BCI systems that maximize benefit as 






opposed to profit 






Ownership of intellectual property as an 






impediment or incentive to biomedical advances 






The influence of funding sources on research 






priorities 



output under different intellectual prop- 
erty regimes. However, there is only one 
opportunity to get current decisions right, 
and that is now. Another reason is that 
bioethical decisions depend not only on 
values and principles, but also on the 
facts of the matter, which we have lim- 
ited ability to anticipate in the distant 
future. Only as we live through each of 
the eras summarized in Table 1 will we be 
positioned to predict the likely empirical 
constraints on the ethical decisions of the 
next era. 

For example, how current BCI work 
is financed, who controls intellectual 
property and so forth, will set our course 
toward the next set of issues, the decisions 
on what gets commercially developed, 
how patients get access, and what kind 
of enhancements are available. Then, 
depending on our experience with what- 
ever mix of technologies is developed in 
that medium-term period — which sen- 
sory, motor and cognitive systems can 
be effectively augmented for therapy and 
enhancement, what unanticipated benefits 
and harms emerge — we will have a much 
better platform from which to foresee 
and address the currently imponderable 



long-term ethical challenges of BCIs and 
transhumanism. 
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